Bayesian Bandwidth Selection for a Nonparametric Regression Model with Mixed Types of Regressors
نویسندگان
چکیده
This paper develops a sampling algorithm for bandwidth estimation in a nonparametric regression model with continuous and discrete regressors under an unknown error density. The error density is approximated by the kernel density estimator of the unobserved errors, while the regression function is estimated using the Nadaraya-Watson estimator admitting continuous and discrete regressors. We derive an approximate likelihood and posterior for bandwidth parameters, followed by a sampling algorithm. Simulation results show that the proposed approach typically leads to better accuracy of the resulting estimates than cross-validation, particularly for smaller sample sizes. This bandwidth estimation approach is applied to nonparametric regression model of the Australian All Ordinaries returns and the kernel density estimation of gross domestic product (GDP) growth rates among the organisation for economic co-operation and development (OECD) and non-OECD countries.
منابع مشابه
On the performance of nonparametric specification tests in regression models
Some recently developed nonparametric specification tests for regression models are described in a unified way. The common characteristic of these tests is that they are consistent against any alternative hypothesis. The performance of the test statistics is compared by means of Monte Carlo simulations, analysing how heteroskedasticity, number of regressors and bandwidth selection influence the...
متن کاملSmooth Varying-Coefficient Nonparametric Models for Qualitative and Quantitative Data∗
We propose a nonparametric varying coefficient method that admits both qualitative and quantitative regressors. The proposed estimator is exceedingly flexible and has a wide range of potential applications including hierarchical (mixed) settings, small area estimation, and so forth. For example, the method provides for semiparametric models in which practitioners can select a parametric functio...
متن کاملNonparametric Regression Applied to Quantitative Structure-Activity Relationships
Several nonparametric regressors have been applied to modeling quantitative structure-activity relationship (QSAR) data. The simplest regressor, the Nadaraya-Watson, was assessed in a genuine multivariate setting. Other regressors, the local linear and the shifted Nadaraya-Watson, were implemented within additive models--a computationally more expedient approach, better suited for low-density d...
متن کاملBayesian Inference for Spatial Beta Generalized Linear Mixed Models
In some applications, the response variable assumes values in the unit interval. The standard linear regression model is not appropriate for modelling this type of data because the normality assumption is not met. Alternatively, the beta regression model has been introduced to analyze such observations. A beta distribution represents a flexible density family on (0, 1) interval that covers symm...
متن کاملNonparametric Bayesian Kernel Models
Kernel models for classification and regression have emerged as widely applied tools in statistics and machine learning. We discuss a Bayesian framework and theory for kernel methods, providing a new rationalization of kernel regression based on nonparametric Bayesian models. Functional analytic results ensure that such a nonparametric prior specification induces a class of functions that span ...
متن کامل